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TITLE 

MULTI-QUEUE SINGLE -FIFO ARCHITECTURE FOR QUALITY OF SERVICE 

ORIENTED SYSTEMS 

BACKGROUND OF THE INVENTION 

5 Field of the Invention 

The invention relates to communication systems, and 
more particularly to a multi-queue single-FIFO scheme for 
quality of service (QoS) oriented systems. 
Description of the Related Art 

10 With the convergence of communication and computing 

technology, processing platforms have been integrated with 
communication systems to provide enhanced service features 
and resource allocation. Such a processing platform is 
typically coupled to a communication network and hosts 

is several processes for transmitting data to or receiving data 
from nodes on the communication network. A processing 
platform may be configured to allocate resources to provide 
a quality of service (QoS) for particular communication 
service supported by the processing platform. 

20 A processing platform integrated as part of a 

communication system may include a peripheral device coupled 
to a communication medium and a host system to receive data 
from the peripheral device and transmit data to the 
communication medium through the peripheral device. A 

25 peripheral bus typically transfers data between the host 
system and the peripheral device. The processing platform 
that supports QoS and resource allocation typically uses 
multiple queues in which each queue is associated with a 
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particular QoS requirement and/or a particular data flow. 
These queues should be effectively processed per their 
respective priorities, for example, to permit many data 
flows to be individually scheduled per their respective 
5 negotiated QoS levels. 

As far as is known, most conventional peripheral 
devices carry out QoS guarantees over multiple first- in- 
first-out (FIFO) buffers, i.e., they employ many FIFO 
buffers to service multiple queues. The FIFO buffer is 

10 usually implemented with registers or memory units that 
occupy the majority of an IC (integrated circuit) chip area. 
Therefore, the geometry of an IC chip increases as it 
includes more FIFO buffers. Unfortunately, the larger the 
chip size, the more costs and power consumption are 

15 incurred. Accordingly, there is a need to address such 
problems of the related art. It would be desirable to 
provide a multi-queue system with reduced number of FIFO 
buffers, thereby accomplishing overall system cost 
effectiveness . 

2 0 SUMMARY OF THE INVENTION 

The present invention is generally directed to multi- 
queue single-FIFO architecture for quality of service 
oriented systems. According to one aspect of the invention, 
a multi -queue network apparatus for quality of service 
25 oriented communication is disclosed. The apparatus of the 
invention comprises a host system and a peripheral module. 
The host system comprises a system memory and a peripheral 
bus. The system memory has multiple queues each of which is 
configured to store data packets to be transmitted. The 
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peripheral module includes an arbiter, a FIFO buffer, and 
physical layer interface logic. The arbiter, adapted to 
interface with the peripheral bus, maintains a number of 
next access pointers targeting each queue within the system 
5 memory, respectively, determines which queue is to be 
serviced next contingent upon a quality of service policy, 
and fetches at least one data packet identified by the 
chosen queue's next access pointer. The FIFO buffer is 
connected between the arbiter and the physical layer 

10 interface logic; it is capable of storing and managing the 
fetched data packet in a first- in- first-out manner. The 
physical layer interface logic accepts each data packet from 
the FIFO buffer and prepares the packet for transmission on 
a physical medium. 

15 According to another aspect of the invention, a multi- 

queue network apparatus is made up of a host system and a 
peripheral module. The host system comprises a system 
memory and a peripheral bus. The system memory has multiple 
queues each of which is configured to store data packets to 

20 be transmitted. The peripheral module includes an arbiter, 
a data path controller, and two FIFO buffers. The arbiter, 
adapted to interface with the peripheral bus, maintains a 
number of next access pointers targeting each queue within 
the system memory, respectively, determines which queue is 

25 to be serviced next contingent upon a quality of service 
policy, and fetches at least one data packet identified by 
the chosen queue's next access pointer. The data path 
controller is connected to the arbiter and accepts therefrom 
the fetched data packet. The two FIFO buffers, connected in 

30 parallel to the data path controller, are responsible for 
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storing and managing the fetched data packet in a first- in- 
first-out manner. Furthermore, the data path controller 
allows one of the FIFO buffers to be filled with the fetched 
data packet while the other FIFO buffer is engaged in 
5 outgoing transference. 

According to yet another aspect of the invention, an 
apparatus for servicing multiple queues in a host system 
using reduced number of FIFO buffers is provided. The 
apparatus of the invention includes an arbiter, a FIFO 

10 buffer, and physical layer interface logic. The arbiter 
maintains a number of next access pointers for the multiple 
queues storing data packets to be transmitted. 
Additionally, the arbiter is able to determine which queue 
is to be serviced next contingent upon a quality of service 

is policy and fetch at least one data packet, identified by the 
chosen queue's next access pointer, through a peripheral bus 
by means of direct memory access. The FIFO buffer is 
connected between the arbiter and the physical layer 
interface logic; it is used to store and manage the fetched 

20 data packet in a first-in-first-out manner. The physical 
layer interface logic accepts each data packet from the FIFO 
buffer and prepares the packet for transmission on a 
physical medium. 

DESCRIPTION OF THE DRAWINGS 

25 The present invention will be described by way of 

exemplary embodiments, but not limitations, illustrated in 
the accompanying drawings in which like references denote 
similar elements, and in which: 



4 



Client's ref . : P52US 

Our ref. : 07 5 1 -A3 01 4 9US/ f ina.1 /M . F . Lin/Kevin 

FIG. 1 is block diagram of a QoS oriented system for 
transferring data to or from a physical medium according to 
an embodiment of the invention; 

FIG. 2 is a block diagram of a peripheral module 
5 transferring data packets from a host system with multiple 
queues according to an embodiment of the invention; and 

FIG. 3 is a block diagram of a peripheral module 
transferring data packets from a host system with multiple 
queues according to an alternative embodiment of the 
10 invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Reference throughout this specification to "one 
embodiment" or "an embodiment" indicates that a particular 
feature, structure, or characteristic described in 

15 connection with the embodiments is included in at least one 
embodiment of the present invention. Thus, the appearances 
of the phrase "in one embodiment" or "an embodiment" in 
various places throughout this specification are not 
necessary all referring to the same embodiment. 

20 Furthermore, the particular features, structures, or 
characteristics may be combined in one or more embodiments. 
As to the accompanying drawings, it should be appreciated 
that not all components necessary for a complete 
implementation of a practical system are illustrated or 

25 described in detail. Rather, only those components 

necessary for a thorough understanding of the invention are 
illustrated and described. Furthermore, components which 
are either conventional or may be readily designed and 
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fabricated in accordance with the teachings provided herein 
are not described in detail. 

FIG. 1 is a block diagram of a QoS oriented system for 
transferring data to or from a physical medium 5 according 
5 to an embodiment of the invention. A host system 1 
comprises a central processing unit (CPU) 10 and system 
memory 12 coupled by a system bus 14; it may host 
application processes. The system memory 12 may be any 
combination of random access memory (RAM) or non-volatile 

10 memory devices (e.g. hard disk or flash memory) . However, 
this is merely an example of a host system and embodiments 
of the present invention are not limited in this respect. A 
peripheral module 3 is coupled to communicate with the 
physical medium 5. The physical medium 5 may be any one of 

15 several media suitable for data transmission according to a 
communication protocol, including, for example, coaxial 
cabling, twisted pair lines, optical fiber cabling, or a 
wireless medium. The peripheral module 3 is coupled to the 
system bus 14 through a peripheral bus 18 and bridge 16. 

20 The term "bridge" refers to a device that connects multiple 
buses together. The peripheral bus 18 may be a peripheral 
component interconnect (PCI) bus or universal serial bus 
(USB) . These are merely examples of the bus 18 and 
embodiments of the present invention are not limited in this 

25 respect. According to an embodiment, processes hosted on 
the CPU 10 and memory 12 may forward data to the peripheral 
module 3 to be transmitted through the physical medium 5. 
Similarly, the peripheral module 3 may receive data from the 
physical medium 5 to be transmitted to the CPU 10 and memory 

30 12 as input to processes hosted thereon. 
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FIG. 2 is a block diagram of the peripheral module 3 
transferring data packets from the host system 1 with 
multiple queues according to an embodiment of the invention. 
Throughout the description of the present invention, the 
5 term "data packet" shall be understood to include any 
grouping of one or more data elements of any size, including 
data cells, data bytes, and the like. The host system 1 and 
the peripheral module 3 may communicate with each other 
through the PCI bus 18 for example. The PCI bus 18 may 

10 transfer data between the system memory 12 and the 
peripheral module 3 using a "direct memory access (DMA) " 
through which data can be transferred in the bus independent 
of one or more processes hosted on the host system 1 . For 
example, the peripheral module 3 may act as a bus master to 

15 initiate PCI bus transactions to store or retrieve data in 
the memory 12 at the host system 1. However, this is merely 
an example of how a host system and peripheral module may 
communicate and embodiments of the present invention are not 
limited in this respect. A portion of the host system's 

20 resources, such as the system memory 12, are allocated to 
multiple queues within the system. In one embodiment, the 
memory 12 includes a number of queues 123, each of which is 
configured to store data packets to be transmitted. The 
host system 1 maintains several lists of descriptors 121 

25 targeting each queue within the system memory 12, 
respectively. Each list of descriptors comprises access 
information for the data packets stored in an associated 
queue. Each descriptor is responsible for identifying one 
data packet. A descriptor as referred to herein relates to 

30 a data structure including the location of a data packet 
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within the system memory 12. However, this is merely an 
example of a descriptor and embodiments of the present 
invention are not limited in this respect. 

With continued reference to FIG. 2, the peripheral 
5 module 3 includes an arbiter 32, a FIFO buffer 34, and 
physical layer interface logic 36. The arbiter 32 is 
adapted to interface with the peripheral bus 18. According 
to the invention, the arbiter 32 maintains several next 
access pointers targeting each queue within the system 

10 memory 12, respectively, and determines which queue is to be 
serviced next contingent upon a QoS policy. In one 

embodiment, each next access pointer points to the 
descriptor subsequent to a previous descriptor within a list 
of descriptors for a queue, in which the previous descriptor 

15 identifies the data packet that has just been fetched from 
the queue. Once the arbiter 32 determines a suitable queue, 
it fetches at least one data packet identified by the chosen 
queue's next access pointer. Flows of access information 
and data packets are herein indicated by a thin and thick 

20 line, respectively. The next access pointers may be 
initialized by the host system 1 and then advanced upon 
access to one of the descriptor lists 121 for locating a 
queue 123 . The peripheral module 3 can thus select a 
descriptor to locate a memory location storing a subsequent 

25 data packet to be transmitted and initiate DMA transfers to 
fetch the data packet in accordance with the QoS policy. 
The FIFO buffer 34 is connected between the arbiter 32 and 
the physical layer interface logic 34 for storing and 
managing the data packets from the arbiter 32 in a first-in- 

30 first-out manner. Then the physical layer interface logic 
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36 accepts each data packet from the FIFO buffer 34 and 
prepares the packet for transmission on the physical medium 
5. The arbiter, FIFO buffer and physical layer interface 
logic may be implemented with any combination of logic in an 
5 application specific integrated circuit (ASIC) or firmware. 
Therefore, the single FIFO architecture of the invention in 
effect reduces the chip size and power consumption for the 
peripheral module 3 . 

With reference to FIG. 3, an alternative embodiment is 

10 illustrated. The embodiment of FIG. 3 is similar to that of 
FIG. 2 except the use of double-buffering scheme. In this 
embodiment, the peripheral module 3 further includes a data 
path controller 33 and another FIFO buffer 35 in addition to 
the arbiter 32, the FIFO buffer 34 and the physical layer 

15 interface logic 36. The data path controller 33 is 
connected to the arbiter 32 and accepts one or more fetched 
data packets from a chosen queue within the system memory 
12. The two FIFO buffers 34 and 35, connected in parallel 
to the data path controller 33, are responsible for storing 

20 and managing the fetched data packet in a first- in- first-out 
manner. The data path controller 33 allows one of the FIFO 
buffers to be filled in with the fetched data packet while 
the other FIFO buffer is being engaged in outgoing 
transference. This results in improved throughput. The 

25 FIFO buffers 34 and 35 on the other side are also connected 
in parallel to the physical layer interface logic 36 that 
prepares the data packet for transmission on the physical 
medium 5. Therefore, reduction in the number of FIFO 
buffers increases overall system cost effectiveness. 
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In view of the above, the present invention discloses 
multi-queue single-FIFO architecture for QoS-based systems. 
More particularly, the present invention provides a solution 
to cut size, cost, and power consumption while supporting 
5 QoS over multiple queues. 

While the invention has been described by way of 
example and in terms of the preferred embodiments, it is to 
be understood that the invention is not limited to the 
disclosed embodiments. To the contrary, it is intended to 
10 cover various modifications and similar arrangements (as 
would be apparent to those skilled in the art) . Therefore, 
the scope of the appended claims should be accorded the 
broadest interpretation so as to encompass all such 
modifications and similar arrangements. 
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